Using augmented reality to perform complex print jobs

ABSTRACT

Systems and methods are provided for using augmented reality to create a printing template. The method includes capturing, using a camera of a mobile electronic device, a real world image of a surface. The method further includes, by a processor, receiving the real world image, processing the real world image to isolate and measure a portion of the surface on which print job content is to be applied, creating a printing template conforming to a shape and area of the isolated and measured portion of the surface, causing the real world image to be output on a display, and causing the display to output the printing template over the real world image, overlaid over the isolated and measured portion of the surface.

RELATED APPLICATIONS AND CLAIM OF PRIORITY

This application claims priority to and is a continuation of U.S. patentapplication Ser. No. 16/774,154, filed Jan. 28, 2020, the disclosure ofwhich is hereby incorporated by reference in its entirety.

BACKGROUND

The present disclosure relates to custom print design and, inparticular, to using augmented reality (AR) to scan three-dimensional(3D) surfaces to design customized printing templates to be applied tothe 3D surfaces.

When designing rectangular print designs to be applied totwo-dimensional surfaces, determining the length and width of the finaldesign is fairly straightforward practice, given that only a length anda width are needed to complete the task. However, not every surface is atwo-dimensional surface, and not every surface calls for a rectangularprint. For these types of custom prints, the measurements needed todesign the print become more complicated.

For example, custom print decals may be designed for use on multiplestair risers wherein the assemblage of the plurality of decals on themultiple stair risers forms an image. When viewing stair risers from thefront, the width of each subsequent stair riser appears narrower thanthe width of the stair riser preceding it. Because of this, for a customprint job involving stair risers, not only do the measurements of eachindividual stair riser have to be taken into account, but also the depthof the stairs to account for this perceived change in width. Thesevariables result in a complex and time-consuming series of measurementsand calculations in order to properly design a template to be applied tothe image that is to be printed onto the stair riser decals.

In addition to 3D surface measurements such as those taken of stairrisers, other custom print jobs may require non-rectangular printparameters. These surfaces, like the stair riser surfaces, often requirecomplex and precise measurements in order for the print job to beaccurately be applied to the desired surface.

Due to the complexities of these surfaces and the accompanying prints,it is both difficult and time-consuming to design such custom printtemplates. Therefore, for at least these reasons, a better system andmethod of measuring complex surfaces and designing complex customizedprint templates is needed.

SUMMARY

According to an aspect of the present disclosure, a method for usingaugmented reality to create a printing template is provided. The methodincludes capturing, using a camera of a mobile electronic device, a realworld image of a surface. The method further includes, by a processor,receiving the real world image, processing the real world image toisolate and measure a portion of the surface on which print job contentis to be applied, creating a printing template conforming to a shape andarea of the isolated and measured portion of the surface, causing thereal world image to be output on a display, and causing the display tooutput the printing template over the real world image, overlaid overthe isolated and measured portion of the surface.

According to various embodiments, the mobile electronic device iscommunicatively coupled to the display.

According to various embodiments, the printing template includes aplurality of separate template portions. Each of the separate templateportions is configured to be applied to a unique portion of the printjob content.

According to various embodiments, each of the plurality of templateportions has an area and measured dimensions.

According to various embodiments, the method further includes receivinga selection of a type of print job.

According to various embodiments, the type of print job includes walldecals, wraps, window covers, stair risers, textiles, stickers, signage,crafts, and/or any other suitable types of print jobs.

According to various embodiments, processing the print isolating andmeasuring the portion of the surface further includes automaticallyidentifying and isolating the portion of the surface correlating withthe type of print job selected.

According to various embodiments, the method further includes, by theprocessor, applying the print job content to the printing template,causing the print job content to be displayed over the real world image,overlaid over the isolated and measured portion of the surface.

According to various embodiments, the method further includes, by agraphical user interface, selecting the print job content.

According to various embodiments, selecting the print job contentincludes uploading an image.

According to various embodiments, selecting the print job contentincludes selecting content from a list of available content.

According to various embodiments, the method further includes, by agraphical user interface, ordering a finalized print of the print jobcontent conforming to the printing template.

According to another aspect of the present disclosure, a system forusing augmented reality to create complex printing templates isprovided. The system includes a mobile electronic device, which includesa memory, a processor, a graphical user interface, and a camera. Thecamera is configured to capture a real world image of a surface, thegraphical user interface is configured to enable a user to select printjob content, and the memory is configured to store software that, whenrun by the processor, causes the processor to receive the real worldimage, process the real world image to isolate and measure a portion ofthe surface on which the print job content is to be applied, create aprinting template conforming to a shape and area of the isolated andmeasured portion of the surface, cause the real world image to be outputon a display, and cause the display to output the printing template overthe real world image, overlaid over the isolated and measured portion ofthe surface.

According to various embodiments, the system further includes thedisplay, and the mobile electronic device is communicatively coupled tothe display.

According to various embodiments, the software, when run by theprocessor, further causes the processor to apply the print job contentto the printing template, causing the print job content to be displayedover the real world image, overlaid over the isolated and measuredportion of the surface.

According to various embodiments, the printing template includes aplurality of separate template portions. Each of the separate templateportions is configured to be applied to a unique portion of the printjob content.

According to various embodiments, the software, when run by theprocessor, further causes the processor, when applying the print jobcontent to the printing template, to determine a change in depth betweeneach of the separate template portions, and resize each of the uniqueportions of the print job content according to the change in depth.

According to various embodiments, the graphical user interface isfurther configured to enable the user to select a type of print job.

According to various embodiments, the type of print job includes walldecals, wraps, window covers, stair risers, textiles, stickers, signage,crafts, and/or any other suitable types of print jobs.

According to various embodiments, selecting the print job contentincludes uploading an image.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an example of a system for using augmented reality (AR) tocreate complex printing templates, in accordance with variousembodiments of the present disclosure.

FIG. 2 is an example of a system for designing and ordering customprinted material, in accordance with the present disclosure.

FIG. 3 is a screen shot of an example of a print job type selectionmenu, using a graphical user interface, in accordance with the presentdisclosure.

FIG. 4 is a screen shot of an example of a print job type selectionmenu, using a graphical user interface, in accordance with the presentdisclosure.

FIG. 5 is a screen shot of an example of a display of a camera viewingangle, in accordance with various embodiments of the present disclosure.

FIG. 6 is a screen shot of an example of a display of a camera viewingangle displaying a printing template in an AR view, in accordance withvarious embodiments of the present disclosure.

FIG. 7 is a screen shot of an example of a display of a camera viewingangle identifying and labeling risers on a staircase in a real worldimage, in accordance with various embodiments of the present disclosure.

FIGS. 8-9 is a flowchart of an example of a method for using AR tocreate and order complex printed material, in accordance with variousembodiments of the present disclosure.

DETAILED DESCRIPTION

As used in this document, the singular forms “a,” “an,” and “the”include plural references unless the context clearly dictates otherwise.Unless defined otherwise, all technical and scientific terms used hereinhave the same meanings as commonly understood by one of ordinary skillin the art. When used in this document, the term “comprising” (or“comprises”) means “including (or includes), but not limited to.” Whenused in this document, the term “exemplary” is intended to mean “by wayof example” and is not intended to indicate that a particular exemplaryitem is preferred or required.

In this document, when terms such “first” and “second” are used tomodify a noun, such use is simply intended to distinguish one item fromanother, and is not intended to require a sequential order unlessspecifically stated. The term “approximately,” when used in connectionwith a numeric value, is intended to include values that are close to,but not exactly, the number. For example, in some embodiments, the term“approximately” may include values that are within +/−10 percent of thevalue.

Other terms that are relevant to this disclosure are defined at the endof this Detailed Description section.

Referring now to FIG. 1, a system 100 for using augmented reality (AR)to create complex printing templates is provided.

According to various embodiments, the system 100 includes a mobileelectronic device 105. The mobile electronic device 105 includes amemory 110, a processor 115, a graphical user interface 120 whichincludes a display 125, and a camera 130. The camera 130 is configuredto capture a real world image of a surface 135 on which a printingtemplate is displayed. The “real world image” is a photographicrepresentation of an area that is in the field of view of the camera130. The mobile electronic device 105 may be configured to display theimage of the surface on its display 125 along with an AR simulation ofthe template superimposed over the surface 135 on the display 125.According to various embodiments, the template includes print jobcontent. The “print job content” is the content, selected by the user,which is to be printed. It may include images, text, and/or any othersuitable printable content. The print job content may be selected by auser using the graphical user interface 120. According to variousembodiments, one or more components of the system 100 such as, forexample, the camera 130, the display 125, and/or the graphical userinterface 120, may be incorporated in a single electronic device and/ora plurality of electronic devices in electronic communication with eachother. For example, the camera 130 may be a standalone camera 130,coupled to a separate device, or a component of the mobile electronicdevice 105. According to various embodiments, the system 100 may includea plurality of cameras 130 configured to enable the system 100 to takestereoscopic images for three-dimensional image analysis. According tovarious embodiments, the real world image is a stereoscopic image.

According to various embodiments, a user positions the mobile electronicdevice 105 such that the camera 130 is able to capture a real worldimage and/or video of the surface 135. According to various embodiments,the memory 110 is configured to store software/programming instructionswhich, when run by the processor 115, causes the processor 115 toanalyze the real world image in order to identify and isolate one ormore portions of the surface 135 in the real world image on which aprint of the print job content is to be applied. Once the surface 135 isisolated, the programming instructions cause the mobile electronicdevice 105 to automatically determine one or more measurements of thesurface 135. According to various embodiments, each of the portionsforms a geometric shape having measured dimensions and a calculablearea.

According to various embodiments, the software/programming instructionsinclude one or more frameworks for performing object detection and/ormeasurement on objects in real world images. The one or more frameworksfor performing object detection and/or measurement may include, forexample, the scale-invariant feature transform (SIFT) framework, thehistogram of oriented gradients (HOG) framework, the Viola-Jones objectdetection framework, the single shot multibox detector (SSD) framework,and/or any other suitable framework for detecting and/or measuringobjects in real world images. According to various embodiments, the oneor more frameworks for performing object detection and/or measurementsmay incorporate motion detection, shadow analysis, stereoscopic imageanalysis, and/or any other suitable relevant means for facilitatingobject detection and/or measurement. Motion detection, shadow analysis,and/or stereoscopic image analysis may be used for determining objectdetection, depth, distance, movement, and/or facilitating themeasurement one or more sides of a surface of an object detected in thereal world image. These and/or other methods of image analysis determinethe shape of a surface of a detected object and may be used to determineand isolate a surface 135 of a detected object.

Once the system detects a surface, the system also may use one or morepoints of reference information to measure the object. For example, thesystem may ask a user to provide measurement characteristics for one ormore facets of the surface. Alternatively, the system may ask the userto enter identifying information for an object in the image having knowndimensions, and the system may correlate the dimensions of the objectwith the dimensions of a field of view. Then, when the surface ontowhich the print job content appears in the field of view, the system maydetermine how much of the field of view the object takes up, andassociate corresponding dimensions with the surface. For example, thesystem may determine that a known object is 5 cm wide and takes up 5% ofthe horizontal dimension of the field of view. If so, it may determinethat the field of view has a horizontal dimension of 100 cm. Then, whenthe surface appears in the field of view, the system may determine whatpercent of the field of view is taken by the horizontal dimension of thesurface, and it may then multiple that percentage by the total field ofview horizontal dimension (such as 100 cm) to determine the horizontaldimension of the surface.

According to various embodiments, the real world image analysis fordetecting and measuring an object and isolating a surface 135 isperformed using the mobile electronic device 105. According to otherembodiments, the real world image analysis for detecting and measuringan object and isolating a surface 135 is performed using a remote deviceand/or server and the results of the analysis are sent to the mobileelectronic device 105.

According to various embodiments, once an object is detected and/ormeasured and the surface 135 is isolated, the surface' 135 shape and/orsize is compared to the shape and sizes of known surface types. If thesurface's 135 shape and/or size is within an acceptable range from thatof a known surface type, the surface 135 is determined to be of theknown surface type. According to various embodiments, the surface's 135size and/or shape may be within the acceptable range of two or moresurface types.

According to various embodiments, one or more of the programminginstructions may be stored on one or more remote servers or datacenters, accessible to the mobile electronic device 105 via a wired orwireless connection (for example, via the cloud).

The measurements determined by the system 100 enable a printing templateto be generated which would accurately fit over the isolated surface135, wherein the printing template conforms to the shape of the isolatedsurface. The measurements may include surface area measurements such aslength and width. The measurements may also include depth measurementsand/or position measurements in the event that multiple surfaces 135 aremeasured. For example, if the surface 135 includes multiple stairrisers, the positions of the stair risers in three-dimensional space andthe depth between each of the multiple stair risers is calculated. Thesemeasurements may be used in altering the perspective of the image to beapplied to the print template such that a viewer of the applied finalprint would accurately view the image from a particular perspective. Forexample, if a printing template includes a plurality of templateportions, the print job content may be resized depending on the depthand/or angle of the template in three-dimensional space.

Once the printing template is generated, the mobile electronic device105 may overlay the printing template over the real world image,presenting the user with an AR view, using the display 125 to displaythe AR image to the user. According to various embodiments, the printingtemplate overlaying the real world image includes the print job content,enabling the user to view how the final printed product will look onceit is printed and applied to the surface 135. According to variousembodiments, the printing element, when incorporating the print jobcontent, forms a proof.

According to various embodiments, the graphical user interface 120projects, onto the display 125, a print job content selection menu 300,as shown in FIG. 3. The print job content selection menu 300 may includea first selection tool 305 for making one or more selections of printjob content from a list of stock content (for example, stock images,stock text, etc.) stored on the mobile electronic device 105 and/oraccessible via a remote server, and a second selection tool foruploading print job content. According to various embodiments, prior toimaging the surface 135 using the camera 130, the user selects the typeof print job 135 to be printed.

According to various embodiments, the graphical user interface 120projects, onto the display 125, a print job selection menu 400, as shownin FIG. 4. The print job selection menu 400 includes one or more printjob types 405 and/or images/diagrams 410 of various print job types fromwhich the user may select. The print job types are selectable on themenu 400 (for example, using a mouse, a touch screen, and/or any othersuitable selection means using the graphical user interface 120),enabling the user to select a print job type. As shown in FIG. 4, thetype of print job 405 may include, for example, wall decals, wraps,window covers, stair risers, textiles, sticker, signage, crafts, and/orany other suitable print job types.

The memory 110 may be preprogrammed with software that, when run by oneor more processors 115, enables the mobile electronic device 105 todetermine the shape of one or more objects in the real world image inthree-dimensional space, the to identify, isolate, and measure one ofmore of the one or more objects. Upon initiating image capturing by thecamera 130, the system 100 may instruct the user to point the camera's130 viewing angle toward a specific type of surface that correlates to aselected print job, if a type of print job was selected. According to anexample, a user has selected a staircase riser as the type of print job.In this example, as shown in FIG. 5, one or more real world images 505are captured by the camera 130 and displayed to the user on the display125. Furthermore, in this example, since the user selected a print jobtype (the staircase), the system displays a notification 510 (“Point atstaircase”) to the user on the display 125 to aim the viewing angle ofthe camera towards an example of the selected print job type (thestaircase). The notification 510 may be displayed over the capturedimage or may be on any suitable position on the display 125. Accordingto various embodiments, an analyzation grid 515, designating whichportion of the real world image 505 is being analyzed, is displayed overthe real world image 505 in order to aid in positioning the camera's 130viewing angle over the desired surface on which the selected print jobcontent is to be applied.

According to various embodiments, after the camera 130 captures the realworld image of the surface 135, the image is analyzed for surfacessuitable for the type or types of print job selected by the user usingthe graphical user interface 120. The suitable surface types forselected print job types may include, for example, flat surfaces,textured surfaces, multiple surfaces along the same plane or alongmultiple planes, and/or any other suitable type of surface for aselected type of print job. According to various embodiments, if no typeof print job is selected, the mobile electronic device may be programmedto identify one or more print jobs based on the surfaces identified inthe real world image captured by the camera 130, and present these oneor more print jobs as suggestions to the user, enabling the user toselect a print job from the one or more recommended print jobs.According to various embodiments, the print job type is automaticallydetermined based on the image analysis. For example, the image analysismay determine a shape and/or dimensions of a surface. The determinedshape and/or dimensions may be compared against known shapes and/ordimensions of known print job types. If the shape and/or dimensions ofthe surface in the analyzed image match the known shape and/ordimensions of a known print job type, within an acceptable margin oferror, the surface in the analyzed image may be associated with thatknown print job type.

If the system detects a surface on which the print job content may beapplied, the system highlights the surface on the display, overlaid overthe real world image, presenting the user with an AR view of the realworld image with the overlaid highlighted surface. The measurements ofthe surface are then calculated by the system.

Using these measurements, the system 100 generates a printing templatebased on the identified and isolated surface and displays the printingtemplate over the real world image 505. As shown in FIG. 6, an ARenvironment 605 is displayed to the user on the display 125, wherein theprinting template 610 is overlaid onto the isolated surface, enablingthe user to view the real world image 505 and the printing template 610.In the example shown in FIG. 6, the printing template 610 includes aplurality of components, wherein each component is positioned on a stairriser in the real world image 505. It is noted, however, that theprinting template will be unique for each real world image and dependenton the print job type and the isolated surface.

According to various embodiments, the print job content is overlaid overthe printing template 610, providing the user with an AR environmentview of the surface with the print job content applied to the surface,as shown in FIG. 7. According to various embodiments, the printingtemplate is displayed along with the measured dimensions 705 of theprinting template, which approximately coincide with the measureddimensions of the surface on which the print job content is to beapplied. For example, as shown in FIG. 7, the surface is a series ofstair risers, and the number of stair risers, the height of each stairriser, and the width of each stair riser are displayed to the user in anAR environment.

Referring now to FIG. 2, a system 200 for designing and ordering customprinted material is provided.

According to various embodiments, one or more customers/users 205 accessan electronic device (for example, a laptop computer 210, a smartphone215, a tablet computer, and/or any other suitable electronic device).The electronic device is configured to enable the customer/user 205 toselect print job content to be printed and customized to specificdimensions so as to enable the print job content to be applied to asurface. The electronic device may further be configured to identify,define, and/or measure the surface on which the print job content is tobe applied, and to aid the customer in ordering the custom printmaterial incorporating the print job content.

The print job content may be uploaded by the customer/user 205 or may beselected from one or more examples of print job content offered 206 tothe user via a digital application. An example screen shot of a printjob content selection menu is shown in FIG. 3, which enables thecustomer/user 205 to select from one or more examples of stock contentor to upload content or take a custom image. Content from which thecustomer/user 205 may select may be separated into one or morecategories. If the user chooses to upload an image, any images availablefor upload may be displayed to the user. If the user chooses to inputtext, a text box for inputting the text may be displayed to the user.The digital application may be a website and/or standalone software,which may be accessed by the electronic device 210, 215. According tovarious embodiments, the one or more examples of stock content offeredare sent to the electronic device via a remote host 220. Once theprinting template is created and the print job content selected, thecustomer/user 205 may send an order 207 for the custom print material tothe remote host 220. The electronic device and the remote host 220 maybe in electronic communication with each other.

Based on information pertaining to the custom print material (forexample, the location of the customer/user, the size of the printingtemplate, the complexity of the shape of the printing template,capabilities based on pricing and incentives, and/or any other relevantinformation), the remote host 220 generates a list of printing providers225 and presents 208 the list of printing providers to the user via agraphical user interface coupled to the electronic device. The generatedlist of providers 225 may include, for example, the names of theproviders, the location of the providers, any reviews/ratings for any ofthe providers, a quoted price for the custom print material for each ofthe providers, and/or any other suitable information pertaining to theproviders. According to various embodiments, any pricing and/orincentives from each of the providers 225 are sent 212 to the host todissemination to the customer/user 205.

The customer/user 205, upon receiving the list of providers, may rate209 the providers. The customer/user selects 211 a provider 225 tocreate the custom print material 230 (also known as the product) andsubmits the order to the selected provider 225, with payment. Detailspertaining to this order are then sent to the selected provider 225. Theorder details 213 and process and payment 214 are sent to the provider225

Once the order is made to the selected provider 225, the selectedprovider creates the product 230 and ships, at 235, the product 230 tothe customer/user 205.

According to various embodiments, the system 200 includes a print deviceconfigured to perform a print job designed by the system 200,eliminating the need to send the print job to a provider 225 forprinting. According to this embodiment, the user 205 sends the printorder, in the form of a print job file, from the electronic device 210,215 to a print device in electronic communication with the electronicdevice 210, 215 via a wired and/or wireless network or connection.According to various embodiments, the user 205 may save the print jobfile to a portable memory device for insertion into the print device,enabling the print device to read the print job file and perform aprinting function, producing the completed print product.

Referring now to FIGS. 8-9, a flowchart of an example of a method 800for using AR to create and order complex printed material is provided.

According to various embodiments of the present disclosure, one or morefunctions of method 800 are performed using a digital application run onan electronic device. The digital application, at 805, is run on theelectronic device. Programming instructions for running the digitalapplication and for performing one or more of the functions of themethod 800 may be stored on the electronic device and/or may be accessedremotely by the electronic device. According to various embodiments,prior to running the digital application, the digital application isdownloaded onto the electronic device.

Using a graphical user interface coupled to the electronic device, at810, an image is selected from an image selection menu. The selectedimage is the print job content which is to be printed onto the complexprinted material. The print job content may be an image, text, and/orany other suitable form of printable content. According to variousembodiments, selecting the image includes uploading a custom image usingthe graphical user interface. According to various embodiments,selecting the print job content includes selecting content from aselection of stock content available through the digital application.

The final print job content to be printed is designed to be applied to asurface. Therefore, the selected print job content, or a portionthereof, is to be applied to the surface. According to variousembodiments, at 815, a type of print job is selected by the user,wherein the type of print job correlates with a suitable surface ontowhich the printed material is to be applied. The type of print job mayinclude wall decals, wraps, window covers, stair risers, textiles,stickers, signage, crafts, and/or any other suitable type of print job.According to another embodiment, a type of print job is not selected andvarious types of print jobs are recommended based on one or moresurfaces identified in a captured real world image.

In order to identify the surface on which the print job content is to beapplied, one or more real world images of one or more surfaces arecaptured, at 820, using a camera. The camera may be coupled to theelectronic device, coupled to a portable memory device, and/or is itselfa standalone device. If a type of print job has been selected, theelectronic device may, at 825, instruct the user to aim the viewingangle of the camera towards a surface correlating with a selected typeof print job. Once the surface is in the viewing angle of the camera,the electronic device, at 830, identifies, locates, and isolates thesurface, overlaying a marker over the real world image at the locationof the surface on a display in electronic communication with theelectronic device, creating an AR environment view of the real worldimage for analyzation by a user, as shown in FIG. 6.

The electronic device, at 835, measures the dimensions of the surface inthe real world image. According to various embodiments, the measurementis performed in conjunction with the detection of the object on whichthe surface is located. According to various embodiments, themeasurement is performed subsequent to the detection of the object.Using the measurements, position, and shape of the isolated surface, theelectronic device, at 840, creates a printing template on which theprint job content is to be applied. At 845, the electronic devicedisplays the printing template to the user on the display, with themeasurements, using the display, in an AR view. According to variousembodiments, the printing template includes the selected print jobcontent, forming a digital proof of the finalized printed material,enabling the user to see the surface with the print job contentoverlaid.

If the user approves of the printing template, the user, at 850, submitsthe printing template with the selected print job content to be ordered.The user, at 855, is presented with one or more suppliers to choose fromto complete the order. The user then, at 860, selects a provider andsubmits the order to the provider. The provider then, at 865, producesthe printed material and ships the printed material to the user.

According to an alternative embodiment, the print order creates a printfile, which is sent to a print device, by the user, to print the printfile. According to various embodiments, the print device is inelectronic communication with the electronic device. According tovarious embodiments, the print file is stored on a portable memorydevice which is read by the print device.

In this document, “electronic communication” refers to the transmissionof data via one or more signals between two or more electronic devices,whether through a wired or wireless network, and whether directly orindirectly via one or more intermediary devices. Devices are“communicatively connected” if the devices are able to send and/orreceive data via electronic communication.

The term “portable memory device” refers to a portable device that has anon-transitory storage medium capable of storing data, such as auniversal serial bus (USB) flash drive, a secure digital (SD) card ormicroSD card, a portable hard disk, a portable media player or any otherportable memory device that has such storing capability. In variousembodiments, the portable memory device does not need to include aprocessor. The portable memory device will typically have a file system.The portable memory device will include a data transfer device, such asa USB connector for a USB drive, input/output ports of an SD card or aradio unit (transceiver) of a near-field communication device such as aBluetooth device.

A “computer,” “computing device,” or “electronic device” refers to adevice that includes a processor and non-transitory, computer-readablememory. The memory may contain program instructions that, when executedby the processor, cause the computing device to perform one or moreoperations according to the program instructions. Examples of computingdevices include personal computers, servers, mainframes, gaming systems,televisions, and portable electronic devices such as smartphones, smartwatches, wearable electronic devices, digital cameras, fitness trackingdevices, tablet computers, laptop computers, media players and the like.

The term “print device” refers to a machine having hardware capable ofreceiving a digital document file and use the information from the fileand associated print instructions to print a document represented in thefile on a substrate and produce a physical document. Components of aprint device typically include a print engine, which includes printhardware such as a print head, which may include components such as aprint cartridge containing ink, toner or another print material, as wellas a document feeding system configured to pass a substrate through theprint device so that the print head can print characters and/or imageson the substrate. A print device may have additional capabilities suchas scanning or faxing and thus may be a multifunction device.

A “print job” refers to a set of instructions that causes a print deviceto print one or more document files. In this document, the set ofinstructions may be from a user to a print device, or it may begenerated by a system or the print device after detecting a triggerevent.

The features and functions described above, as well as alternatives, maybe combined into many other different systems or applications. Variousalternatives, modifications, variations or improvements may be made bythose skilled in the art, each of which is also intended to beencompassed by the disclosed embodiments.

The invention claimed is:
 1. A method for using augmented reality tocreate a printing template, the method comprising: by a processor:receiving, on a mobile electronic device, a real world image of asurface; processing the real world image to isolate and measure aportion of the surface on which print job content is to be applied;creating a printing template conforming to a shape and area of theisolated and measured portion of the surface, wherein the printingtemplate includes a plurality of separate template portions, whereineach of the separate template portions is configured to be applied to aunique portion of the print job content; and causing a display to outputthe printing template over the real world image.
 2. The method of claim1, wherein the mobile electronic device is communicatively coupled tothe display.
 3. The method of claim 1, wherein each of the plurality ofseparate template portions has an area and measured dimensions.
 4. Themethod of claim 1, further comprising receiving a selection of a type ofprint job.
 5. The method of claim 4, wherein the type of print jobcomprises one or more of the following: wall decals; wraps; windowcovers; stair risers; textiles; stickers; signage; and crafts.
 6. Themethod of claim 5, wherein processing the real world image furthercomprises automatically identifying and isolating the portion of thesurface correlating with the type of print job selected.
 7. The methodas recited in claim 1, further comprising, by the processor, applyingthe print job content to the printing template, causing the print jobcontent to be displayed over the real world image, overlaid over theisolated and measured portion of the surface.
 8. The method as recitedin claim 1, further comprising, by a graphical user interface, selectingthe print job content.
 9. The method of claim 8, wherein selecting theprint job content includes uploading an image.
 10. The method of claim8, wherein selecting the print job content includes selecting contentfrom a list of available content.
 11. The method of claim 1, furthercomprising, by a graphical user interface, ordering a finalized print ofthe print job content conforming to the printing template.
 12. A systemfor using augmented reality to create complex printing templates, thesystem comprising: a mobile electronic device including: a memory; aprocessor; and a graphical user interface, wherein the graphical userinterface is configured to enable a user to select print job content,and wherein the memory is configured to store software that, when run bythe processor, causes the processor to: receive a real world image;process the real world image to isolate and measure a portion of thesurface on which the print job content is to be applied; create aprinting template conforming to a shape and area of the isolated andmeasured portion of the surface,  wherein the printing template includesa plurality of separate template portions, wherein each of the separatetemplate portions is configured to be applied to a unique portion of theprint job content; and cause a display to output the printing templateover the real world image.
 13. The system of claim 12, furthercomprising the display, and wherein the mobile electronic device iscommunicatively coupled to the display.
 14. The system of claim 13,wherein the software, when run by the processor, further causes theprocessor to apply the print job content to the printing template,causing the print job content to be displayed over the real world image,overlaid over the isolated and measured portion of the surface.
 15. Thesystem of claim 12, wherein the software, when run by the processor,further causes the processor, when applying the print job content to theprinting template, to: determine a change in depth between each of theseparate template portions; and resize each of the unique portions ofthe print job content according to the change in depth.
 16. The systemof claim 12, wherein the graphical user interface is further configuredto enable the user to select a type of print job.
 17. The system ofclaim 16, wherein the type of print job comprises one or more of thefollowing: wall decals; wraps; window covers; stair risers; textiles;stickers; signage; and crafts.
 18. The system of claim 16, whereinselecting the print job content includes uploading an image.
 19. Amethod for using augmented reality to create a printing template, themethod comprising: receiving a selection of a type of print jobincluding one or more of the following: wall decals; wraps; windowcovers; stair risers; textiles; stickers; signage; and crafts; and by aprocessor: receiving a real world image; processing the real world imageto automatically identify, isolate, and measure a portion of the surfacecorrelating with the type of print job selected and on which print jobcontent is to be applied; creating a printing template conforming to ashape and area of the isolated and measured portion of the surface; andcausing a display to output the printing template over the real worldimage.
 20. The method of claim 19, wherein the mobile electronic deviceis communicatively coupled to the display.
 21. The method of claim 19,wherein the printing template includes a plurality of separate templateportions, wherein each of the separate template portions is configuredto be applied to a unique portion of the print job content, and whereineach of the plurality of separate template portions has an area andmeasured dimensions.
 22. The method as recited in claim 19, furthercomprising, by the processor, applying the print job content to theprinting template, causing the print job content to be displayed overthe real world image, overlaid over the isolated and measured portion ofthe surface.
 23. The method as recited in claim 19, further comprising,by a graphical user interface, selecting the print job content.
 24. Themethod of claim 23, wherein selecting the print job content includesuploading an image.
 25. The method of claim 23, wherein selecting theprint job content includes selecting content from a list of availablecontent.
 26. The method of claim 19, further comprising, by a graphicaluser interface, ordering a finalized print of the print job contentconforming to the printing template.